Adaptive Overlays for Shared Stream Processing Environments

© Adaptive Overlays for Shared Stream Processing Environments Olga Papaemmanouil, Sujoy Basu, Sujata Banerjee HP Laboratories HPL-2007-178(R.1) stream processing, overlay, quality-of-service Large-scale overlays has become a powerful paradigm for deploying stream processing applications in wide-area environments. The dynamic nature of these systems makes it difficult to guarantee the Quality of Service (QoS) requirements of each application. In this work we present a framework for distributing stream processing applications, where processing components and stream flows could be shared across multiple applications. In our approach, nodes coordinate to precompute alternative network deployments for each application that respect both node constraints and the applications' QoS requirements. Given this set of alternative deployments, nodes can react fast to changes on the network conditions, workload or application expectation. External Posting Date: October 6, 2008 [Fulltext] Approved for External Publication Internal Posting Date: October 6, 2008 [Fulltext] A Brief version published in Proceedings of the 4th International Workshop on Networking Meets Databases (NetDB) Copyright 2008 Hewlett-Packard Development Company, L.P. Adaptive Overlays for Shared Stream Processing Environments Olga Papaemmanouil Brown University [email protected] Sujoy Basu HP Labs [email protected] Sujata Banerjee HP Labs [email protected]